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ONE-DIMENSIONAL LINEAR RECURSIONS WITH 
MARKOV-DEPENDENT COEFFICIENTS 

By Alexander Roitershtein 

University of British Columbia 

For a class of stationary Markov-dependent sequences (y4„, _B„) € 
R , we consider the random linear recursion Sn — "f* ^nSn—l^ ^ £ 
Z, and show that the distribution tail of its stationary solution has a 
power law decay. 

1. Introduction and statement of results. Consider the stochastic differ- 
ence equation 

(1.1) Sn = An + BnSn-l, ?i G N, 5„ G M, 

with real- valued random coefficients An and Bn- 

If the sequence of random pairs {An, Bn)n€Z is stationary and ergodic, 
ii^(log |i?o|) < 0, and E{log |^o|^) < oo, where x+ = max(0, x), then for any 
initial random value 5o, the limit law of Sn is the same as that of the 
random variable R = Aq + J2n^=i A~nTVi=o B-i, and it is the unique initial 
distribution under which (5n)n>o is stationary (cf. [6]). Letting £^n = A-n 
and pn = B-n for n G Z, we get 

oo n—1 

(1.2) R = i0 + Y.^nX{pi. 

n=l i=0 

The stochastic difference equation (1.1) has been studied by many authors 
and has a remarkable variety of applications (see, e.g., [8, 20, 23] for an 
extensive account). The distribution tail of the random variable R is the 
topic of, for example, [9, 10, 11, 12, 14], all assuming that {pn,Cn)n£Z is an 
i.i.d. sequence, and of [7], where it is assumed that {pn)nez is a finite Markov 
chain. 
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We study here the asymptotic behavior of the distribution tail of R in 
the case that the sequence (Cn)nez = {^n, Pn)ne'E is an "observable part" of 
a Markov-modulated process. By Markov-modulated process we mean the 
following: 

Definition 1.1. Let {S,T) be a measurable space and let {xn)n& be 
a stationary Markov chain with transition kernel H{x,-) defined on it. 

A Markov-modulated process (MMP) associated with {xn)nez is a sta- 
tionary Markov chain (x^, Cn)nez defined on a product space (5 x T, T® S), 
whose transitions depend only on the position of (x^). That is, for any 
n€Z,A£T, BgE, 

P{xneA,Cn^B\a{{xi,Ci)-i<n))= / H{x,dy)G{x,y, B)\^=^^_^, 

J A 

where G{x, y, •) = P{Ci € -{xq = x, x\ = is a kernel on (5 x 5 x H). 

For MMP (x„,Cn)nGZ, where Cn = (Cn,Pn), satisfying Assumption 1.2 
below we show that for some k > 0, the limits limj_>oo f^PiR > t) and 
limt^oof^PiR < —t) exist and are not both zero. Under our assumption, 
the parameter k is determined by 

(1.3) A(k) = 0, where A(/3) = lim -logs fn Ip/V 

\ 1=0 / 

This extends both the one-dimensional version of a result of Kesten which 
is valid for i.i.d. variables {^m Pn)n& (cf. [14], Theorem 5, see also an alter- 
native approach developed by Goldie in [9]) as well as the recent result of 
de Saporta [7] where it is assumed that (pn)nez is a finite irreducible and 
aperiodic Markov chain independent of the process (^n)nGZ which is an i.i.d. 
sequence. 

In the joint paper with Eddy Mayer- Wolf and Ofer Zeitouni [16], in the 
context of an application to random walks in random environments, we 
treated the particular case where i-*(Co = liPo > 0) = 1 and {pn)nez is a 
point-wise transformation of a stationary Markov chain {xn)n£Z which is 
either finite-state and irreducible (possibly periodic) or such that some power 
of its transition kernel is dominated from above and below by a probability 
measure (and thus is aperiodic). 

The general case is more involved and requires additional arguments to 
deal with it. We consider here the following Markov-modulated model where 
the coefficients {Cm Pn)nez of the linear recursion (1.1) are not necessarily 
positive, the underlying Markov chain (xn)nGZ is defined in a general state 
space and may be periodic, and the sequences (^n)nez and {pn)nez are not 
assumed to be independent. 

Let B denote the Borel fj-algebra of M. 
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Assumption 1.2. There is a stationary Markov chain {xn)nez on a 
measurable space {S,T) with transition kernel H(x,-) such that {xn,Cn)n&z, 
where 



is a MMP on {S x M^^T x B^^) and: 

(Al) The a-field T is countahly generated. 

(A2) The kernel H{x,-) is irreducible, that is, there exists a a-finite 
measure tp on {S,T) such that for all x gS, J2'n=i ^ ^) > whenever 
^{A) > 0. 

(A3) There exist a probability measure fi on {S,T), a number mi G N, 
and a measurable density kernel h{x,y) — > [0,oo) such that 



and the family of functions {h(x,-) :S [0,oo)}x£S is uniformly integrable 
with respect to the measure fi. 

(A4) P(|^o| < c^) = 1 for some > 0. 

(A5) P{c~^ < \po\ < Cp) = 1 for some Cp > 1. 

(A6) Let A(/3) = limsup„^oo^log£'(n"JoMPil^O- Then there exist con- 
stants Pi>0 and P2>0 such that A(/9i) > and A(/32) < 0. 

(A7) There do not exist a constant a > and a measurable function 
p-.S X { — 1, 1} [0,a) such that 



Remark 1.3. The assumption that the sequence {xn,Cn)n£Z is station- 
ary is explicit in Definition 1.1 of Markov- modulated processes. It turns 
out (see Lemma 2.1 below) that under assumptions (Al)-(A3), the Markov 
chain {xn)n& has a unique stationary distribution. This distribution in- 
duces a (unique) stationary probability measure for the sequence (Markov 
chain) {xn,Cn)nez, which we denote by P. The expectation according to the 
stationary measure P is denoted by E. 

Note that condition (A6) implies by Jensen's inequahty that £'(log |po|) < 
0. Thus, by a theorem of Brandt [6], the series in (1.2) converges absolutely, 
P-a.s. It will be shown later (see Lemma 2.3 below) that the both lim sup's 
in (A6) is in fact a limit, and thus this condition guarantees, by convexity, 
the existence of a unique k in (1.3). 

Assumption (A7) ensures that log|/3„| is nonarithmetic (in the sense of 
the following definition) relative to both the underlying process {xn)nez as 
well as to the auxiliary chain {xn)nez introduced in Section 4. 



Cn — {^n: Pn) 




P{log\pi \ G /3(xo,r/) -P{xi,r]- sign(/9i)) + a • Z) = 1 



/or r/G {-1,1}. 
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Definition 1.4 ([2, 22]). Let (x„,g„)„gz beaMMP. The process (g„)nGZ 
is said to be nonarithmetic relative to the Markov chain (x„)„gz if there do 
not exist a constant a > and a measurable function /? : 5 — > [0, a) such that 

P((7oG/3(x_i)-/3(xo) + a-Z) = l. 

We will next state our results for the coefficients {£,n, Pn)n&z satisfying 
Assumption 1.2. We will denote 

(1.4) p-(-) =P(-|x_i =x) and E- {■) = E{-\x^i = x), 

and keep the notation Px{-) and Ex{-) for P{-\xo = x) and E{-\xq = x), 
respectively. 

The case of positive coefficients {(,m Pn)nei, is qualitatively different from 
and technically simpler than the general one [e.g., it turns out that in this 
case limj^oo t'^P{R > t) is always positive], and it will be convenient to treat 
it separately. 

Theorem 1.5. Let Assumption 1.2 hold and denote by vr the stationary 
distribution of the Markov chain (x„)„gz- 

If P{Co > 0, /Oo > 0) = 1 then for n-almost every x € S, the following limit 
exists and is strictly positive: 

K{x) = lim t''P~{R>t), 

t— >oo 

where the parameter k, is given by (1.3) and the random variable R is defined 
in (1.2). 

An application of Theorem 1.5 and estimates (1.7), (1.8) to random walks 
in random environments can be found in [16]. The main step of the proof 
follows Goldie's argument (cf. [9], Theorem 2.3) closely and relies on the 
application of a version (due to Alsmeyer, cf. [2]) of the Markov renewal 
theorem due to Kesten (cf. [15], see also [4, 22] and references to related 
articles in [15]). 

For coefficients {Cn, Pn)nez with arbitrary signs we have: 

Theorem 1.6. Let Assumption 1.2 hold and denote by vr the stationary 
distribution of the Markov chain {xn)nez- 

Then, with k given by (1.3) and R defined in (1.2), 

(a) For TT-almost every x £ S, the following limits exist: 

(1.5) Ki{x) = lim i'"P^(i? > t) and K^i{x) = lim f^P^iR < -t). 

t— »oo t—*oo 



(b) 7r(Ki(x)+ir_i(x)>0)G{0,l}. 
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(c) // Condition G (see Definition 1.7 below) is satisfied then it holds that 
7r{Ki{x) = K-i{x)) = 1. Moreover, if Condition G is not satisfied then ei- 
ther tt{Ki{x) > and K^i{x) > 0) € {0, 1} or there exists a (possibly trivial) 
partition of S into two disjoint measurable sets A and B such that ir-a.s., 
Ki{x) > and K-i{x) = for x G A whereas Ki{x) = and K-i{x) > for 
xeB. 

Definition 1.7. We say that Condition G holds if there does not exist 
a (possibly trivial) partition of S into two disjoint measurable sets Ai and 
A_i such that for i £ {—1, 1}, 

P(xo eAi,xie A-i,pi > 0) = P{xo e Ai,xie Ai, pi <0)=0. 

Condition G is a generalization of the condition of Z-irreducibility intro- 
duced in [7]. Note that this condition is not satisfied if P{po > 0) (take Ai = 
S and A^i = 0). Proposition 4.1 shows that Condition G is equivalent to the 
assertion that the Markov chain x.„ = {xn,'jn), where jn = sign(po • • ■ Pn-i), 
is irreducible under Assumption 1.2. 

The proof of Theorem 1.6 is basically by applying a Markovian adaptation 
of the implicit renewal theory of Goldie [9] (see Section 3) to the Markov 
chain x„ and the random walk Vn = J27=o ^^s\Pi\- The Markov chain x„ 
carries the necessary information about the sign of the products of pi and at 
the same time, as we shall see in Section 4, inherits all essential properties 
of the Markov chain Xn. 

In order to show that Ki{x) + K_i(x) > in Theorem 1.6, we need an 
extra nondegeneracy assumption which guarantees that the random variable 
R is not a deterministic function of the initial state x_i. Again following [9] 
and using the renewal theory developed in [2], we complement Theorem 1.6 
by the following necessary and sufficient condition for R to be nondegener- 
ate under P~ and for the limit to be positive. This condition is a natural 
generalization of the criterion that appears in the case where the random 
variables {£,n,Pn) are i.i.d. (cf. [14] and [9]). Note that the condition is triv- 
ially satisfied under the assumptions of [7] [because {^n)n€Z is assumed to 
be independent of {xn)nez]- 

Theorem 1.8. Let Assumption 1.2 hold and denote by vr the stationary 
distribution of the Markov chain {xn)nez- Then: 

(a) 7r(Ki(x) + K-i(x) > 0) = if and only if there exists a measurable 
function F : 5 — > M such that 



(1.6) 



^'(eo + r(xo)po = r(x_i)) = i. 
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(b) There exists a constant Ci > such that for n-almost every x £ S, 

(1.7) >t) < C7i Vt>0. 

In particular, limt^oof^PiR > t) = E{Ki{x-i)), limt-,oo t^P{R < -t) = 
E{K-i{x-i)), and the limits are finite. 

(c) // (1.6) does not hold for any measurable function T:S^M., then 
there exist positive constants C2 and t^ such that for tt -almost every x £ S, 

(1.8) t''P~{\R\>t)>C2 yt>tc. 

In particular, limj_^oo t^P{R > t) and limt_,oo t'^P[R < —t) are not both zero. 



Remark 1.9. Throughout this paper we work with the probabihty mea- 
sures P^{-) = P{-\x-i = x) defined in (1.4) rather than with -Pr(-) = ^(-l^^o = 
x). Since 

P^{R >t) = E (^P~ > = a,po = 

the bounded convergence theorem and part (b) of Theorem 1.6 show that 
all our results hold also for the usual conditional measure Px- 

However, treating the linear recursion (1.1) in the setup of Markov- modulated 
processes, it is not so natural to work with the conditional probabilities Px. 
In order to elucidate this point, let us consider the following two examples: 

(i) The random variable R is conditionally independent of the "past," 
that is, of cr{{^n, pn)n<o), given x^i but not given xq. 

(ii) Let T > be a finite random time such that Xr is distributed according 
to a probability measure ip, and define -P^(-) := Px{-)ip{dx) and Rr = 
^T- -|- J2'^=T+i in riitTr Pi- Then in general, since the distribution of Xr-i and 
hence that of {(,t,Pt) are unknown, 

P{Rr£-)^P4R£-). 
On the other hand, P(i?r+i £-) = P;^iRe •) for P^(-) := P' {■)'ip{dx). 

The rest of the paper is organized as follows. Section 2, divided into three 
subsections, is mostly devoted to the properties of the Markov chain {xn)n£Z 
and of the random walk Vn = J2i=o \Pi\- Section 2.1 is devoted to the basic 
properties of the underlying Markov chain {xn)n&- In Section 2.2 we state a 
Perron-Frobenius type theorem (Proposition 2.4) which plays an important 
role in the subsequent proofs and in particular implies the existence and 
uniqueness of k in (1.3) (see Lemma 2.3). The proof of Proposition 2.4 is 
deferred to the Appendix. Section 2.3 is devoted to the Markov renewal 
theory which is then used in Section 5, where it is applied to the Markov 
chain x„ = {xn,^n) and the random walk Vn. Section 3 contains a reduction 
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of Theorems 1.5 and 1.6 to a renewal theorem which is an adaptation of 
a particular case of Goldie's implicit renewal theorem (cf. [9]). Section 4 is 
devoted to study of the auxiliary Markov chain Xn- The main goal here is to 
show that the renewal theorem obtained in Section 3 can be applied to the 
couple {xnjVn)- The proofs of the main results (Theorems 1.5, 1.6 and 1.8) 
are then completed in Section 5. 

2. Background and preliminaries. Similarly to the i.i.d. case (cf. [9] and 
[14]), the asymptotic behavior of the tail of R under Assumption 1.2 is 
determined by the properties ofVn = J2^=o I Pi I ^^'^ ™ particular is closely 
related to the renewal theory for this random walk. This section is devoted 
to the properties of the Markov chain {xn)n£Z and of the associated random 
walk with Markov-dependent increments. The aim here is to provide for 
future use some technical tools, namely the regeneration times Ni defined in 
Section 2.1 by the Athreya-Ney-Nummelin procedure, a Perron-Frobenius 
theorem for positive kernels stated in Section 2.2, and the Markov renewal 
theory recalled in Section 2.3. 

2.1. Some properties of the underlying Markov chain {xn)nez- First, let 
us note that assumption (A3) implies that the transition kernel H is quasi- 
compact. Recall that a transition probability kernel H{x,-) on a measurable 
space (5,T) is called quasi-compact if there exist constants e G (0,1), 6 £ 
(0, 1), nil G N, and a probability measure such that H'^^{x,A) < e when- 
ever fJ,{A) < 6, or alternatively, H'^^{x,A) > 1 — e whenever fJ,{A) > 1 — 5. If 
a quasi-compact kernel H is the transition kernel of a Markov chain {xn)nez, 
then the chain is also called quasi-compact. The condition on transition ker- 
nels used in this definition was introduced by Doeblin (see, e.g., [24] for a 
historical account). 

In the following lemma we summarize some properties of quasi-compact 
chains which will be useful in the sequel (see Theorem 3.7 in [21], Chapter 6, 
Section 3 for the first three assertions, Proposition 5.4.6 and Theorem 16.0.2 
in [17] for the fourth, and Propositions 3.5, 3.6 in [21], Chapter 3, Section 3 
for the last one). 

Lemma 2.1. Let {xn)n& be an irreducible quasi-compact Markov chain 
defined on a measurable space (5,T). Then, there exist a number d G N [the 
period of {xn)n&l,\ o sequence of d disjoint measurable sets {Si,S2, ■ ■ ■ ,Sd) 
(a d-cycle), and probability measures vr and ip on {S,T) such that: 

(i) The following holds for all i = 1, . . . ,d, and x £ Si: H{x,Sj) = for 
j = i + l (mod d) . 

(ii) vr is the unique stationary distribution of (x„), 7r(5i) > for i = 
1, . . . , d, and tt{Sq) = 1, where Sq = Uf=i 'Si- 
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(iii) {xn)nez is Harris recurrent chain when restricted to the states of 
the set Sq. That is, P{xn G A i.o. fom > 0\xq = x) = 1, for all x Sq and 
measurable ACSq with 7r{A) > 0. 

(iv) ip{Si) = 1, and there exist constants r G (0, 1) and m e N such that 

(2.1) H"'{x,A)>ril:{A) VxG5i,AgT. 

(v) The process {xn)n& is ergodic under its stationary distribution. 

The minorization condition (2.1) with some recurrent set Si is equivalent 
to the Harris recurrence (see, e.g., [18]). The particular form of the set Si in 
(iv) as cyclic element is particularly advantageous and is due to the Doeblin 
condition. 

We will next define a sequence of regeneration times {Ni}i:>Q for the 
Markov chain (x„)„gz restricted to {Sq,Tq), where Tq = {A£T:AC1 Sq}. 
Let the set Si and the number m be the same as in (2.1), and let Nq be the 
first hitting time of the set Si : 

(2.2) A^o = inf{n> -l:x„e5i}. 

Note that Nq < d—1 and Nq is a deterministic function of x_i on the set Sq. 
The randomized stopping times Ni, i>l, can be defined in an enlarged (if 
needed) probability space by the following procedure (see [3, 5, 18]). Given 
a state x^Vo S 5i, generate XNo+m as follows: with probability r distribute 
XNo+m over Sq according to ip and with probability 1 — r according to 1/(1 — 
r) • @{xo, •), where the substochastic kernel 0(x, •) is defined by 

(2.3) H"'{x,A) = Q{x,A) + rls,ix)ijiA), x£Sq,A£Tq. 

Then, (unless m = 1) sample the segment {xno+i,xno+2, ■ ■ ■ ,XNo+m~i) ac- 
cording to the {xn)nez chain's conditional distribution, given xtvq and X7Vo+m- 
Generate X]yo+2m and XNo+m+i, XNo+'m+2, ■ ■ ■ ,XNo+2m-i in a similar way, 
and so on. Let {?^j}j>l be the successful times when the move of the chain 
{x]\fo+mn)n>o is according to ip, and set Nj = Nq + mnj, j > 1. Note that Nj 
is not the jth visit to Si. 

By construction, the blocks (xjv^+i, X7V.+2, • • • > a;Afi+i) are one-dependent 
and for i > 1 they are identically distributed (x^v. , i > 1, are independent 
and distributed according to the measure 'ip).lt follows from the construction 
that the random times Ni^i — Ni are i.i.d. for i>0, and that there exist 
constants € N, 6 > 0, such that 

(2.4) P~ {Ni <^)>6 Vx G cSo. 

We summarize the properties of the random times Ni in the following lemma. 
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Lemma 2.2. Let {xn)n& be an irreducible quasi- compact Markov chain 
with state space S, and let the set So be as in Lemma 2.1. 

Then there exists a strictly increasing sequence {Ni)i>Q of random times 
such that: 

(i) (iVj+i - Ni)i>o are i.i.d. 

(ii) The blocks (xj^^^j^, . . . are one-dependent for i>0 and iden- 
tically distributed for i>l, where {xn^)nez is the Markov chain induced by 
{xn)n& on {So, To). 

(iii) No < d — l,yx £ So, where d is the period of [xn)n&- 

(iv) There exist constants ■(? G N and (5 > such that (2.4) is satisfied. 

Throughout the rest of the paper we shall be concerned with the measur- 
able space {So,To), where To = {A£T:A<Z So}, rather than with {S,T). 
Without loss of generality we may and shall assume that 



Otherwise we can restrict our attention to the Markov chain induced by 
{xn)n£Z On the set of full measure tt where the equality in (2.5) does hold. 
Clearly, Assumption 1.2 and Lemma 2.1 remain true for this Markov chain. 

2.2. A Perron-Frobenius theorem for positive bounded kernels. The aim 
of this subsection is to state a Perron-Probenius theorem for positive ker- 
nels (Proposition 2.4 below). Proposition 2.4 is an essential part of the 
subsequent proofs where it is applied to kernels of the form K(x,A) = 



Ex (nr=o |p/;2;n G A) and Q{x,A)=E^ (l{n<iVi} IlLo \Pi\'^;Xn G A), where 



the random time Ni is defined in Section 2.1. The proof of Proposition 2.4 
is deferred to Appendix A. 

One immediate consequence of this proposition is the following lemma 
which proves the existence and uniqueness of the parameter k in (1.3). 

Lemma 2.3. Let Assumption 1.2 hold and let the set So be as defined 
in Lemma 2.1. Then, 

(a) For any /3 > and every x £ So, the following limit exists and does 
not depend on x: 



(2.5) 



-fx (ICol < and IpoI e (cp, ,Cp)) = l Vx G cSq. 



(2.6) 




Moreover, for some constants C/j > 1 that depend on /3 only. 



(2.7) 





10 



A. ROITERSHTEIN 



(b) There exists a unique k > such that A(k) = 0, A(/3)(/? — k) > for 
all p>0. 

We next proceed with Proposition 2.4, from which the lemma is derived 
at the end of this subsection. 

A function K'.SqxTq^ (0,oo) is a positive bounded kernel, or simply 
kernel, if the following three conditions hold: (i) K{-,A) is a measurable func- 
tion on Sq for all A £ Tq, (ii) K{x, •) is a finite positive measure on Tq for all 
X G Sq, (iii) supjjg^ij K{x,So) < oo. Let Bi, be the Banach space of bounded 
measurable real- valued functions on the measurable space {So,Tq) with the 
norm ||/|| = sup^jg^^ Any positive bounded kernel K{x,A) defines a 

bounded linear operator on Bh by setting Kf{x) = /^^^ K{x, dy)f{y). We de- 
note by the spectral radius of the operator corresponding to the kernel 
K, that is 

r^= lim y||K"l|| = lim \I\\KH, 

n— >oo n^oo V 

where l(x) = 1. 

The following proposition generalizes Lemma 2.6 in [16] allowing us to 
deal with a more general class of underlying Markov chains {xn)n&z- 

Proposition 2.4. Let K{x,-) he a positive bounded kernel on {Sq,%) 
and s{x, y) : 5q ^ R 5e a measurable function such that s{x, y) G {ci^ ,ci) for 
some ci > 1 and all E Sq. Assume that there exists a set 5i G 7^ such 

that: 

(i) For some constants (i G N, j»> 0, 

d 

J2k\x,Si)>p yxGSo. 

i=l 

(ii) For some constant m G N and probability measure ^ concentrated on 

Su 

K"'{x,Sf) = Vxg5i, 
where 5f is the complement set of Si, and 

(2.8) K"'{x,A)> f s{x,y)ip{dy) Vx G cSi, .4 G Tq. 

Ja 

Further, assume that: 

(iii) There are a probability measure fi on {Sq,To) and a constant mi G N 
such that for all e > there exists 5 = 6(e) > such that 

(2.9) iJ.{A) < 6 implies sup K™^ [x, A) < e. 

xGSo 
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[This condition entails K{x, ■) <ti /J- for all x G Sq.] 

Let Ti = {A ^Tq-.ACL Si} and let a kernel Q{x^A) on (5i,7i) he such 
that 

K"'{x,A) = e{x,A) + r [ s{x,y)i){dy) yx^Si,A&Ti, 

J A 

for some r G (0, 1). 
Then: 

(a) There exists a function f Bb such that inf^; f{x) > and Kf = r^^f. 

(b) There exists a function g & such that mixg{x) > and Qg = r^g. 

(c) rgG(0,r-). 

The proof of the proposition is included in Appendix A. 

Proof of Lemma 2.3. Let Q{x,y,B) = P{p^n & B\xn-i = x,Xn = y), 
and for any P>0 define the kernel Hp{x, •) on [Sq^Tq) by 

(2.10) Hp{x,dy) = H{x,dy) [ Q{x,y,dz)\zf . 

JR 

Then for any /? > 0, 

(2.11) E-(^f[\p,f^=H^lix) VxG5o. 

The kernels Hp, (3 > 0, satisfy the conditions of Proposition 2.4. It follows 
from (A. 2) with K = Hp that for some constant > 1 which depends on (3 
only, 



(2.12) < E;; n I j ^ c^^^ G 5o, n G N, 

where rp = rn^- This yields assertion (a) of the lemma. The claim of its 
part (b) follows then from the convexity of the function A(/3) which takes 
by assumption (A6) both positive and negative values. □ 

2.3. Markov renewal theory. The proofs of our results rely on the use 
of the following version of the Markov renewal theorem which is due to 
Alsmeyer [2]. Recall Definition 1.1 of Markov-modulated processes and Def- 
inition 1.4 of nonarithmetic processes. Let B denote the Borel cr-algebra of M 
and let (50,^0) be a measurable space such that T is countably generated. 

Theorem 2.5. ([2], Theorem 1) Let {xn)nez be a Harris recurrent Markov 
chain on {Sq,Tq) with stationary distribution vr and let {xn,qn)n&z be an as- 
sociated with it MMP on {Sq xM,Tq x B) such that fiQ := E{qn) > and the 
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process qn is nonarithmetic relative to {xn)n<^'E- Further, let Vn = Yl^=Q^i 
and /ei (7 : 5o X M ^ M he any measurable function satisfying 

(2.13) for TT-a.e. z£SQ,g{z,-) is Lebesgue-a.e. continuous, 
and 

(2.14) / ^ sup \g{z,t)\Tr{dz) < CO for some 5 >0. 

JSo „g2n(5<t<(n+l)<5 

Then, 

(2.15) Urn E~( y2g{xn-i,t-Vn)] = — [ ( g{u,v)dv'n{du), 

Vn^ / 1^0 J So Jm. 

for TT- almost every z gSq. 

Under the assumptions of Theorem 2.5, let a-i = —l,V-i = 0, and for 
n > 0, let an = inf{« > cr„_i : Vi > Kr„_i} be the ladder indexes of the random 
walk Vn- Set Vn = Va„ - Further, for n>0 let x„ = Xo-„-i and qn = Vn — Vn-i 
(Qo = J2ilo^Qi and = J2i=al-i Qn for n > 1). Denote by tti the unique 
stationary measure of the Markov chain {xn)n>o (existing by [2], Theorem 2) 
and by Hi the transition kernel of {xn,qn)n>o- 

For t > 0, set v{t) = inf{n >0:Vn>t}, Z{t) = and W{t) = T4(t) - 

t. Note that v{t) is a member of the sequence {an)n>o- 

Corollary 2.6 ([2], Corollary 2). Let (x„,, T4)„,>o he as in Theorem 2.5. 
Then, with m := J^^ E~ {qo)TTi{dx), 

hmE;ig{Z{t),Wm 

t — ^■oo 

1 



g{v, w) dw Hi{u, dv x ds)TTi{du), 

Atl J So JSox{0,oo) J[0,s) 

holds for TTi-a.e. z £ So and for every measurable function g : Sq x [0, 00) ^ M 
such that the function b{z,y) := E~{g{xo,qo — y)'^{qo>y}) satisfies (2.13) 
and (2.14). 

Theorem 2.5 will be applied in Section 5 to the underlying Markov chain 
{xn)nez restricted to the space {So,Tq) defined in Section 2.1 and to the 
random walk Vn = J27=o^'^s\Pi\- I^i order to enable the application of the 
renewal theorem, we use a standard change of measure argument (involving 
a similarity transform of the transition kernel H) which defines a new 
stationary measure P for the MMP {xn,Cn)nez under which the Markov 
random walk Vn = J2^=o^'^s\Pi\ has positive drift, that is, the expectation 
£^(log|/3o|) with respect to P is strictly positive. 
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We next proceed with the construction of the measure P. Observe that 
in virtue of Lemma 2.3, = 1, where is the spectral radius of the kernel 
on {Sq,Tq) defined in (2.10). Therefore, by Proposition 2.4, there exists 
a positive measurable function h{x) :5o — > M bounded away from zero and 
infinity such that 

(2.16) h{x)= [ H^{x,dy)h{y). 
Let Cn = {in,Pn), n G Z, 

(2.17) H{x,dy):=-^H,{x,dy)h{y), 

h[x) 

and let P be the stationary law of the Markov chain {xn, Cn)nez on 5 x 
with transition kernel 

P{yo£AxB\a{yi:i<0))= [ H{x,dz)G{x, z, B%=^_^, 

J A 

where A^%,B ^ B®'^ and G{x,z,-) = P{Qn G ■\xn-i = = z). That is, 
the law of (Cn)nez = {in,Pn)n& Conditioned upon (x„)„gz is the same un- 
der P and P, whereas the chain {xn)n&'E has transition kernels H and H, 
respectively. We will denote by E the expectation with respect to P and 
will use the notation 

(2.18) p-(-):=P(-|x„i=x) and P,(.) := P(-|xo = x), 

and, correspondingly, E~{-) := E{-\x^i = x) and -E'x(-) := E{-\xq =x). 
Let 

(2.19) Ch:= sup h{x)/h{y). 

x,yeSo 

Since Ch G (0, oo) and c'f^^H{x,A) < H{x,A) < ChH{x,A), we have: 

• Conditions (A1)-(A3) of Assumption 1.2 hold for the kernel H. 

• The Markov chain {xn)nez on (50,70) with the kernel H is Harris recur- 
rent and the minorization condition (2.1) holds in the following form: 

(2.20) H"'{x,A)>rc^^iP{A) VxGcSi,AgT. 

• The invariant measure vr/j of the kernel H is equivalent to vr (this follows, 
for example, from [18], Proposition 2.4). 

• Assumptions (A7) and (2.5) hold for the sequence {Cm Pn)nei. under the 
measure P. 

Lemma 2.7. Let Assumption 1.2 hold. Then ^(log|po|) > 0. 
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Proof. Let Vo = and 

n-l 

(2.21) Vn = J2log\p^\, neN. 

i=0 

With Ch defined in (2.19) we obtain for any x £ So and 7 > 0, 
(2.22) 

1/4 ^ ^ _ _-K7nl/4 



<ChE-{e''^--e^-<e-^''' )<Che 



Thus, Iim„,_»oo Px (^n < — 7n^/^) = 0, implying by the ergodic theorem that 
^(log|po|)>0. 

It remains to show that £^(log|po|) = is impossible. For any x G Sq, 
5 > 0, and [j E (0, k) we get, using Chebyshev's inequality, 

P-{\Vn\<5n) = ^^-(e''^"/i(x„_i);F„ G [-5n,5n]) 

< c;,e'^^"p-(K > -5n) < CHe^''+^^'^E-(^^ . 

It follows from Lemma 2.3 that for all 5 > small enough and some suitable 
constants A,b> that depend on 6, 



(2.23) sup P~ {\Vn\ < 5n) < Ae 



-bn 



Therefore, the ergodic theorem implies that i?(log |/9o|) > 0. □ 

3. Reduction to a renewal theorem. The main goal of this section is to 
prove the following Proposition 3.1 which reduces the limit problem for the 
tail of the random variable iZ to a renewal theorem [namely, to the checking 
that (3.3) below indeed holds a.s.]. Furthermore, some useful estimates are 
obtained here and collected in Lemma 3.2. 

Let Ho = 1 and for n > 1, 

n-l 

(3.1) Un=l[p^. 

i=0 

That is n„ = 7„_ie^" where Vn is defined in (2.21) and 



(3.2) 



7„ :=sign(n„+i), n>-l. 
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Proposition 3.1. Let Assumption 1.2 hold. Further, let the set Sq and 
the measure vr be as in Lemma 2.1 and assume that for some rj G { — 1,1} 
the following limit exists for tt -almost every z € Sq: 

(3.3) Kr,{z) :=^lim E-^^5TO-i(^i-i'*-^i)^> 

where the expectation is taken according to the measure P~ defined in (2.18) 
and the nonnegative functions q^'.SqxM^ [0, oo) are defined for 7 G {—1, 1} 
by 

(3.4) g^{x,t) = v'^iPxilR >v)- PxiliR - eo) > v)] dv. 
Then, for -k -almost every z G 5o, limt_»oo ^^-PTC^-^ > = h{z)K^{z). 

We note that certain particular cases of this proposition are the basis for 
the proofs in [7] and in [16]. All these results are adaptations to various 
Markovian situations of a particular case of the "imphcit renewal" theorem 
of Goldie (cf. Theorem 2.3 in [9]). For the sake of completeness, a proof of 
the proposition is provided at the end of this section. 

We begin by proving the following technical lemma: 

Lemma 3.2. Let Assumption 1.2 hold. Then the following assertions 
hold true: 

(a) There exists constants Mg > and £g > such that for iT-almost every 
X G Sq, 

(3.5) \g.,{x,t)\<Mge-'^\'\ 

for any t G M and r] G { — 1, 1}. 

In particular, for any 5 > there exists a constant M{5) > such that 

(3.6) J2 ( max |(7^(x,t)|j<M(<5) 

^g2n(S<i<(n+l)<5 Ue{-l,l} J 

for IT -almost every x € Sq. 

(b) For any 6 > there exists a constant Af„ = Mu{d) > such that 

00 

J2 sup p-{ViG [-6, 6]) <M,,. 
i=o 2e5o 

(c) There exists a constant > such that, for tt- almost every z £ Sq, 

00 

(3.7) max \grj{xi_i,t - Vi)\^ < Mr Vt G M. 
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Proof, (a) First, assume that t > 0. Let 

(3.8) Ch = maxl/h{x). 

For any e G (0, 1), we get from (3.4): 

\gr,{x,t)\<Che-' r v^\p-{i]R>v)-P-{rj{R-Co)>v)\dv 
Jo 

re' 

(3.9) < c/,e-"* / v^+^-^\P;^ {r]R > v) - P-{v{R - Co) > v)\ dv 

Jo 

< ChK-^e-^'E-i\[{r^Ry]'^+^ - [{rjR - ?7eo)+]''+^|), 

where the last inequahty follows from [9], Lemma 9.4. 

To bound the right-hand side in (3.9) we will exploit an argument similar 
to the proof of [9], Theorem 4.1. We have, 

\gr,{x,t)\ < ChK-\-'^[Il{x) + hix) + h{x) + h{x)], 



where 



h{x) 
hix) 
hix) 
hix) 



E~ilr^io<vR<oivR - vCo)^^'), 
E~ilo<,R<,UvR)''+n, 
E~il,R>OMo<o[ivR - V^o)^^' - ivR)''^']), 

(lo<r,5o<.R[(^i?)"+' - ivR - ^eo)''+1). 



It follows from (2.5) that the sum /i(x) + l2ix) is bounded by c^"'"'". It 
remains therefore to bound Isix) and I^ix). For this purpose we will use the 
following inequalities valid for any 7 > and A > 0, B > (this is exactly 
(9.26) and (9.27) in [9]): 

iA + B)^ <2''iA'' + B^) 

and 

M + m^-A^</^'' , ifo<7<i, 

[A + B) A <[^B{A + B)^-\ if7>l. 

We obtain that Isix) + I^ix) < a^, where 

_^c^+^ ifK + e<l, 

j (k + e)c^2^+^-^E^i\R\^+'-^ + c^+^-^), if k + e > 1. 

By Lemma 2.3 and the ellipticity condition (2.5), for any 5 > small enough, 
there exists a constant > independent of x such that 

(3.10) E- i\R\''-^) < Ls yxeSo. 
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This yields (3.5) for all t > and appropriate constants Mg,eg > that do 
not depend on t. 

Further, (3.4) implies that |(7^(x,0)| < Ch, where the constant Ch is defined 
in (3.8), and that for t < and any e £ (0, k), 

\g^{x,t)\<che-' r v^\p-{r]R>v)-P^ir]{R-^o)>v)\dv 
Jo 

< Che'' / v^-'-^\p-{riR > v) - P-{v{R - Co) >v)\dv 

Jo 

<ChK-'e''E-i\[{vR)+r-'-[{rjR-v^o)^r-'\), 

where the last inequality follows, similarly to (3.9), from [9], Lemma 9.4. 
Thus, for t < 0, 

\9,{x,t)\ < CH^~'e~'\*'\E~{\Rr' + {\R\ + cg)''"^). 

This completes the proof in view of (3.10). 

(b) Follows from (2.23), since P-{Vi € [-6,6]) < P~{Vi £ [-i6,i6]) for any 
X £ So and i G N. 

(c) Fix any 6 > and denote for t G M and n G Z, -^^ 5 = + n6, t + (n + 
1)6). Then, it follows from the previous parts of the lemma that 

00 

J2E;i\g,ixi.,,t-Vi)\) 
i=0 

00 p P 

= ^ I I \gr^{x,t- s)\P~{xi^i£dx,Vi£ds) 
~^ J So Jr 

00 

<Y1 \9vi^^i - s)\^sup P~{Vi£t- I^s) 

00 

< M{6) J2 sup P-m G [-6, 6]) < M{6) ■ M„, 

where the last but one inequality follows from (3.6) and from the fact 
thatsup,e5„E,=on-(^^Gi-^;5)<sup,g5„E^=o^'7(^ie[-<5,<5]) (cf. [2], 
Lemma A. 2). □ 

Proof of Proposition 3.1. Let Uq = i?, and for n > 1, 

n-l 

(3.11) Rn = Y,i^ni, Un = {R-Rn)/^n, 

i=0 
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where n„ are defined in (3.1). Recall that Tl^ = ^n-ie Following Goldie 
[9], we write for any numbers n G N, t G M, rj £ { — 1, 1} and any z £ Sq, 

n-l 
i=0 

+ p-{riUnUn>e'), 

where the random variable Ui is defined in (3.11). 

For n> —1 let x„ = (x^, 7„) and 0, = S x { — 1,1} x R. To shorten the no- 
tation, we denote E7g{-i,i} Xs /r -^(T) 3;, M)/i(7i-i = J,Xi€ dx,Vi £ du) by 
/q F(7, X, M)^(xi G {dx,^),Vi G du) for a measurable function F and a prob- 
ability measure /i on 0. We have, using the identity Ui = ^i + piUi^i, 

P~{r]j,^ie^^Ui > e') - P,irjj,e^^+^U^+i > e*) 

P{r]-fUi > e*""|xi_i = {x,-f),Vi = u)p-{xi^i G {dx,-f),Vi G du) 

- / P{7]-fPiUi+i>e^-''\xi_i = {x,-f),Vi = u) 
Jn 

X P~{xi^i G (fix, 7), G du) 

-<'-^)f^^{x,t- u)P;{xi.i G (dx,7), V, G du), 
where we denote 

f^{x,t) = e^'[p-{jR > e*) - P-{^{R - ^0) > e*)] for 7 G {-1, 1}. 
Thus, letting 5niz,rj,t) = e'^*P~(r/7n_ie^"C/„ > e*) we obtain 

Ui],t) :=e'^*p-(r?i?>e*) 

00 „ 

= / /,,7(a;,t-n)e''"p-(xi_i G (dx,7),yi Gdn) + Jn(2;,r/,t) 
"3^ JO 



e 

n 



i=o- 

n-l 



[ fmi^^'t-'^)-rr-:Pz {xi-i e {dx,-f),Vi e du) + Sn{z,'n,t). 

We have P (limn-too Sn{z, 7], t) = 0) = 1 for any fixed t>0, t] £ { — 1, 1}, and 
z G 5o, because P-a.s., UnUn ^ as n goes to infinity. Therefore P-a.s., 

fz{v,t) = Yl I fviix^'t-u)j^P^{xi-i^{dx,-f),Viedu). 



We will use the following Tauberian lemma: 



LINEAR RECURSIONS WITH MARKOVIAN COEFFICIENTS 19 



Lemma 3.3 ([9], Lemma 9.3). Let R be a random variable such that for 
some constants k > and K >0, limj_>oo Jq u'^P{R > u)du = K. Then 

It follows from Lemma 3.3 that in order to prove that for some rj £ { — 1,1}, 
the limit lim^^oo t'^P{r)R > t) exists and is strictly positive, it suffices to show 
that for vr-a.s. every z € Sq, there exists 

(3.12) limf^(r/,t)G(0,oo), 

t— >oo 

where the smoothing transform q is defined for a measurable function g : M — > 
M bounded on (— oo,t] for all t by q{t) := J^^e~^*~'^^q{u) du. 
For 7 €{-1,1} let 

t 



1 f 



-oo 

1 /■* 



/ e-(*-")e'^"[p-(7ii > e") - p-{j{R - ^o) > e")] du 

J —oo 

/ v'^iP-i^R >v)- P~{j{R - ^o) > v)] dv. 
Jo 



_ e"* '■^ 
h{x 

Then, using (3.7) and the Fubini theorem, we obtain for any z G Sq, 



rt 

fz{ri,t)= / e~^^~^^rz{r],w) dw 



oo 

t 



I e ""^^ / f^Ax,w-u)-^P^ {xi^ie{dx,-f),Viedu)dw 

J —oo i=o il{X) 

oo „ 

V / g^^{x,t-u)h{z)P~{xi-ie{dx,-f),Viedu) 



i=0 

= Kz)E- {^^gryy^_Axi-i,t - Vi)^ . 
This completes the proof of Proposition 3.1. □ 



4. The auxiliary Markov chain Xn = {xn,^n)- To deal with the case 
where P{po < 0) > we introduce the Markov chain Xn = {xn,'Jn), n > — 
where the random variables 7^ are defined in (3.2). It will turn out (cf. 
Proposition 4.1) that the space Sq x {—1,1} can be partitioned into at 
most two measurable subsets such that the restriction of Xn to either one 
of them satisfies Assumption 1.2. Therefore, the Markov renewal theorem 
(Theorem 2.5) can be applied to the irreducible components of the MMP 
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log \ pn\)- This fact is the key to the proof (given in the next section) that 
the hmit in (3.3) exists vr-a.s. and has the properties stated in Theorem 1.6. 

Let H be the transition kernel of on the product space S := 5o x 
{— 1, 1}, and let vr be the probability measure on (3 defined by t:{A x rj) = 
1 /27r(j4) for any rj £ { — 1, 1} and A £ Tq. It is easy to see that vr is a stationary 
distribution of the Markov chain £„. 

Proposition 4.1. Let Assumption 1.2 hold and suppose in addition 
that P{po < 0) > 0. Then, there exist two disjoint measurable subsets Si 
and S_i of & such that: 

(i) Either 7r(ei) = 7r(6_i) = 1/2, or Si = and 6_i = 6. 

(ii) H{x, &n) = 1 for every x G ©„, n = —1, 1. 

(iii) ©1 = if and only if Condition G is satisfied. 

(iv) (Al)-(A3) of Assumption 1.2 hold for the Markov chain {xn)n>-i 
restricted to either ©i (provided that it is not the empty set) or ©_i. 

Proof, (i)-(ii) Say that for x G ©,^ G 7^3,7 G {-1, 1}, 
x'^Axi^} if ^^"(x,^x{7}) = 0, 

n=l 

and x>- Ax {7} otherwise. 

Since the Markov chain (xn)nGZ is vr-irreducible, for any a; G © and AgTq 
such that tt{A) > either x y A x {1} or x >~ A x {—1}. For x G © and 
rje {-1,1} let: 

Frj{x) = {A G To : tt{A) > and x )/- A x {rj}}, 

and set Fix) = Fiix) U F-i{x). Note that Fi{x) n F-i{x) = 0. 

Roughly speaking, the set ©1 is defined below as an element of F{x*) of 
maximal vr-measure for some x* G ©, and ©_i as its complement in ©. 

To be precise, let 

^(x) = sup{7r(A) : A G Fn{x)}, rj G {-1, l},x G ©, 

and ?(x) = ^„i(x) + s^i(x). If ?(a;) = for every x G ©, set ©1 = and 
©_i = ©. Conclusions (i)-(ii) follow trivially in this case, in particular the 
chain (x„,7n) is vr-irreducible. 

Assume now that ?(x*) > for some x* G ©. We will next construct two 
sets Arj, rj G {-1,1}, such that G F -qix*) and vr(A^) = <^^(x*). We will 
then show that <j(x*) = iriAi) + 7r(A_i) = 1 and will define (up to a vr-null 
set) ©1 := (A_i X {-1}) U (Ai X {1}). 

For T] G {—1,1}, let Arj^n G Friix*), n G N, be a sequence of [empty if 
^(x*) = 0] sets in Fr]{x*) such that 7r(A^^„) > ^(x*) — 1/n for any n G N, 
and define A^j = \J^^iAri^n- Since the collections of sets Fr/ix*) are closed 
with respect to countable unions, A^j G F r]{x*) and 7r(Ai) + 7r(A_i) = ?(x*). 
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Put ^0 = ^-1 U Ai, Bo = So- Ao, and set 

6i = (A„ix{-l})u(^ix{l}), 

6_i = {A^i X {1}) U {Ai X {-1}) U {Bo X {1}) U (Bq x {-1}). 

Thus, S_i is the complement of ©i in the set & = Sq x {—1, 1}. Since A^f € 
F-qix*) is the maximal set such that x* )/- Ar^ x {r/}, it follows immediately 
that X* )/- Ax {rf\ and x* >- Ax {—rf\ for any vr-positive A C A^. 

We will now show, using the irreducibility of the Markov chain {x^yi^Ia^ 
that 

(4.1) 7r(iV„iUiVi) =0 where iV^ :={xG e_i:f^^^ X {r/}}. 

Note that (4.1) yields it{Bq) = because for all x £ Sq either (x, 1) G N^j or 
ix,-l)€N^,rjG{-l,l}. 

To see that (4.1) is true, observe that = [j^^^{x:H"^{x,A^ x {r/}) > 
0} are measurable sets, and vr(A^r?) > implies that there exist m £N, Nq £ 
Tq, and 7 € { — 1, 1} such that 

(4.2) ^'"(x*,iVo X {7}) >0 and (x, 7) ^ x {77} VxGiVo- 

But (4.2) yields 

00 

^^™+"(x*,>l,xM) 

n=0 

00 „ 

>^ / H^{x\dyx{^})H^{{y,j),A,x{i^})>0, 

which is impossible since x* ^ x by our construction. 
Finally, we observe that (4.1) implies that 

(4.3) 7r(7V_i UiVi) =0 whereiV^:={xG6i:x^A^x{-7?}}. 

Indeed, if (x,7) G A^,, then (x, —7) G N^j and hence 7r{Nrj) = T^iN^j) = for 
rye {-1,1}. 

To complete the proof, we set 

Si = (A„i X {-1}) U (^1 X {1}) - ]V_i UiVi, 

and 

6_i = (^_i X {l})u(Ai X {-1}) -iV_i UiVi. 

Since 7r(So) = 0, (4.1) and (4.3) imply that #(61) = 7r(6_i) = 1/2 [recall 
that 7r{Ai f] A^i) = 0] and that conclusion (ii) of the proposition holds as 
well. 

(iii) The claim is immediate from the definition of the sets Ai and 
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(iv) Let jl be the probability measure on & defined by fl{A xrj) = l/2fi{A), 
where fi{-) is given by assumption (A3). Since H"^'^ {{x , ^) , A x {r/}) < 
H"^^ (x, A), it foUows from (A3) that there exists a measurable density kernel 
h{x, y) : ^ [0, oo) such that or any x £ 6, r/{ — 1, 1}, A S Tq, 

(4.4) #"^1 (x, A X {7?}) = / h{x, y)fi{dy), 

JAx{ri} 

and the family of functions {h(x, ■):& ^ [O,oo)}xee is uniformly integrable 
with respect to the measure ft. Thus assumptions (Al) and (A3) hold for the 
Markov chain (xn,7n)n>-i- Moreover, the Markov chain (x„,7„)„>„i, when 
restricted to either ©i or S_i, is clearly vr-irreducible which in combination 
with (4.4) shows (iv). □ 

5. Distribution tail of R. In this section we complete the proof of The- 
orems 1.5, 1.6 and 1.8. 

5.1. Proofs of Theorems 1.5 and 1.6 for P{pQ > 0) = 1. In view of Propo- 
sition 3.1, the following lemma completes the proof of Theorem 1.5 and of 
Theorem 1.6 in the case where P(/3o > 0) = 1. 

Lemma 5.1. Let Assumption 1.2 hold and suppose that P{po > 0) = 1. 
Then the following assertions hold true for r] S {—1, 1}. 

(a) The limit in (3.3) exists for ir-a.e. z G Sq and does not depend on z. 

(b) // in addition P{£,o > 0) = 1, then the limit is ir-a.s. strictly positive. 

(c) 7r(K^(x)>0)G{0,l}. 

Proof, (a) In view of Lemma 2.7, estimate (3.6), and the properties 
of the measure P listed right before the statement of Lemma 2.7, we can 
apply Theorem 2.5 to the restriction of the underlying Markov chain {xn)nez 
on {S(),Tq) with transition kernel H, the associated with it random walk 
Vn = J2^=o^os\Pi\} ^-iid the functions defined in (3.4). It follows from 
(2.15) that the limit in (3.3) is vr^-a.s. (and thus also vr-a.s.) equal to 

(5.1) Kr^ = \ [ [ gr,{x,t)7rh{dx)dt, 

a JSo 

where a = -B(log po)- 

(b) It follows from Proposition 3.1 and (5.1) that for vr/j-almost every 
z G Sq (compare with the formula (4.3) in [9]), 

lim t''P~{R>t) 

t—fOO 

= h{z)Ki{z) 
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(5.2) =^ / / gi{x,t)Trh{dx)dt 

a J So JM. 

a Js hyx) JR JO 

— Px{R — Co > v)] dv dt'Kh{dx) 

h(z) f 1 

= ^ TT^ > ^) - P^{R - Co > v)] dvTThidx) 

a Js ri[x) Jo 

= ^ I T^,E-[R''-iR-m^h{dx)>o, 

an Js n[x) 

where the last but one equahty is obtained by change of the order of the 
integration between dt and dv while the last one follows from [9], Lemma 9.4. 
Since vr/i is equivalent to vr and P[R > i? — Co > 0) = 1, this completes the 
proof of the claim. ^ 
(c) The claim follows from Proposition 3.1 and the fact that the limit Ki 
in (3.3) does not depend on z. □ 

5.2. Proof of Theorem 1.6 for P{po < 0) > 0. (a) Just as in the case 
P{po > 0), it follows from Theorem 2.5, applied separately to the irreducible 
components of the Markov chain {xn)n>-i, the random walk Vn, and the 
function gr^^^{xn-i,t — Vn) defined in (3.4), that the limits in (3.3) and hence 
in (1.5) exist for 7r-almost every x £ Sq- 

(b)-(c) We shall continue to use the notation introduced in Section 4. 
Similarly to (2.10), define the kernel Hp{x,-) on 6 by 

Hp{x,dy) = H{x,dy)E{\pof\x-i =x,xo = y), 

and the function /i : S ^ (0, oo) by the following rule: 

h{x) = h{x) forx = (x,7), 

where h:So^M is defined in (2.16). 
For any f = (x, 7) G 6, 

/ H^{x,dy)h{y) = E-{\po\^h{xo))= [ H^{x,dy)h{y) = h{x). 
Je Jso 

Consequently, setting ^(A x ry) = l/2-Kh[A) for ^4 G Tq and G {—1, 1}, we 
have: 

/( / jjzzHK{x,dy)h{y))7rh{dx) 

J6\JAxrih{x) / 

= / 7^]^K{\po\^Kxoy,xoeA)7rh{dx) 
Jso 2h[x) 
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If 1 

= - / H^{X, A)TTh{dx) = -TTh{A) = TTh{A X 7]). 

2 J So ^ 
We will use these facts to write down formulas similar to (5.2) for the limits 
Ki{x) and K-i{x) in (1.5). Claims (b) and (c) of Theorem 1.6 are immediate 
consequences of these formulas. 

First, assume that ©i = 0. That is, by part (iii) of Proposition 4.1, Condi- 
tion G is satisfied. We get from Proposition 3.1 and (2.15) that for vr-almost 
every z £ Sq and t] £ {—1, 1} (compare with (4.4) in [9]): 

I gi{x,t)-Kh{dx)dt+ [ [ g_i{x,t)TTh{dx)dt 



2dK Jso h{x) 

where d = -E'(log |pol)- 

Assume now that &i ^ 0, that is. Condition G is not satisfied. We get 
from Proposition 3.1 and (2.15) that vr-a.s., if {z, 1) G &^ (i.e. z G A^), then 

^r?(2) = 7Tr / / gr^^{x,t)-Kh{dx)dt+ I I g^r,-,{x.,t)-Kh{dx)dt . 

This completes the proof of Theorem 1.6. 

5.3. Proof of part (a) of Theorem 1.8. The "if" part of the claim is 
trivial. Indeed, if (1.6) holds for a measurable function r:5o— >M, then 
substituting = r(x.„_i) — /3„r(xn) into the formula for Rn in (3.11) yields 

n-l 

Rn = T{x-i) - r(3;„_i) Jl Pi. 

i=0 

The Markov chain induced by {xn)nei, ('^c'To) is Harris recurrent by 
Lemma 2.3 and hence P~ {\T{xn-i)\ < M i.o.) = 1 for some M > 0. Since, 
P-a.s., Rn converges to R and Y\!^Zq Pi converges to zero, we obtain that with 
probability one R = r(x_i). Hence for vr-almost every a; € 5, i-*~(|i2| > t) = 
for all t large enough. 

Assume now that lim(_>oo i'^-PaTd-^l > *) = for vr-almost every x £ S. 
Our aim is to show that (1.6) holds for some measurable function P : 5 ^ M. 
First, we will prove the following extension of Grincevicius' symmetrization 
inequality (cf. [13], see also [9], Proposition 4.2 and [7], Lemma 4). It will 
be shown in the sequel that if the right-hand side of (5.4) is a.s. zero, then 
(1.6) holds with the measurable function T{x) defined in (5.3). 

Lemma 5.2. Let yn = {xn,(,m Pn)nez be a MMP associated with Markov 
chains {xn)nez, {£,n,Pn) S o-nd let R he the random variable defined in 

(1.2) . Further, for any x £ S, let 

(5.3) T{x)=mf{a£R:P-{R<a)> 
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Then, for any t>0 and z £ S, 

(5.4) P~{\R\ >t)> ^P~{\Rn + r(2;„_i)n„| > t for some n > 0), 

where the random variables n„ and Rn are defined in (3.1) and (3.11), 
respectively. 

Proof. By its definition, T(x) is a median of the random variable R 
under the measure P~ , that is Px{R > r(x)) > 1/2 and P^iR < r(x)) > 
1/2. Moreover, T(x) is a measurable function of x. 

Fix now any t > and let ti = inf{n > 0:Rn + r(x,i_i)n„ > t}. Since 
T{x) is a median of the distribution P^iR G Oi it follows from the definition 
(3.11) of the random variables Rn and the Markov property that 

oo „ 

Pz{R>t)>Y^ / Pr(Ti=n;Xn-iGdx,n„>0)P;"(i?>r(x)) 

oo „ 

+ E / ^'7(n = n;x„_iGdx,n„<o)p-(i?<r(x)) 

>ip-(ri<oo). 

Replacing the sequence by the sequence — ^„ and consequently R by — i?, 
we obtain [note that we can replace r(a;„) by —T{xn) because the latter is 
a median of —R\: 

P-{-R>t)>^p-{T2<^), 

where T2 := inf{?i > 0:— i?„ — T{xn-i)^n > t}. Combining together these 
two inequalities, we get (5.4). □ 

We will apply this lemma to the Markov chain y* = (x* , Q* , M*)„gZ) 
defined below by a "geometric sampling," rather than to y„ = {xn,(,n, Pn)nez- 
The stationary sequence (x* )„>_! [it is expanded then into the double-sided 
sequence (x* )„gz] is a random subsequence of (xn)n>-i that forms a Markov 
chain which inherits the properties of (xn)nGZ and in addition is strongly 
aperiodic, that is. Lemma 2.1 holds for this chain with d = m = 1. 

Let {rin)n>o be a sequence of i.i.d. variables independent of {xn,S,n, Pn)nez 
(defined in a probability space enlarged if needed) such that P{r]Q = 1) = 1/2 
and P{rjo = 0) = 1/2, and define q-i = —1, Qn = inf{i > Qn-i : 7?i = 1}, Jt- > 0. 
Further, for n > —1 let, 

+ Cgn+2Pg„+l H 1- Cg„+iPg„+lPg„+2 ' ' ' Qg„+T_+1, 



(5.5) Qn+1 — 

K+1 = 
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The transition kernel of the Markov chain (x* )„,>_i is given by 

oo 

(5.6) H*ix,.) = J2C^rH-ix,-). 

n=l 

Hence, {x^)n>-i is Harris recurrent on Sq and its stationary distribution is 
IT. Moreover, the sequence {yn)n>o = i^n^ Qni -^n)n>o is a stationary Markov 
chain whose transitions depend only on the position of a;* and 

oo 71—1 

(5.7) R = Ql + Y^QlX{Ml 

n=l j=0 

Expand {yn)n>o into a double-sided stationary sequence {yn)n&- 
The following corollary to Lemma 5.2 is immediate in view of (5.7). 

Corollary 5.3. Let Assumption 1.2 hold. Then, for any t > and 
zeS, 

(5.8) P-{\R\ >t)> IP-{\K + r«-i)n;| > t for some n > 0), 
where H; := niL'o M* and K ■= EL'o' Ql^t- 

Our aim now is to show that the right-hand side of (5.8) is bounded away 
from zero for 7r-almost every z G 5. The main advantage of using the "ge- 
ometrically sampled" MMP (x* , Q* , M*)„gz is that studying its one-step 
transitions one can obtain some information concerning all possible tran- 
sitions of the original MMP (a;^, p„)„gz- We will use this when passing 
from (5.14) to (5.15) below. 

At some stage of the proof, we shall apply Corollary 2.6 to the Markov 
chain (x*)^^^ and the random walk V* = YllZQ^'^z\^i\ considered under 
the measure P introduced in Section 2.3. Let hp-.So^ (0,oo) be the eigen- 
function of the operator if^ in the space i?;, corresponding to the kernel 
defined in (2.10). This eigenfunction exists and is bounded away from zero 
by Proposition 2.4, and it corresponds to the eigenvalue rp which coincides 
with the spectral radius VHg of the operator. Let 

oo 

(5.9) H*f,{x,dy) = T.^\TH-0^^^-)- 

71=1 

Then, similarly to (2.11), £'-(nr=i 1^^^!^) = i^^"l(a;) for any /? > and 
X ^Sq. _ _ 

Transition kernel H* of x* under P is given by 

~ °° /I \ " ~ 1 

(5.10) H*{x,dy) = Y,[-] H- = -—H:{x,dy)hiy), 
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where as before h{x) = It follows from (5.9) that, as long as < 2, 

Hlhp{x) = -^hpix), 

and thus, as in Proposition 2.4, := is the spectral radius of the oper- 
ator in Bb. In particular, r* = 1. Note also that the invariant distribution 

of H* coincides with the invariant distribution vr/i of H. 

To enable in the use of Corollary 2.6 we need the following two lemmas 
which ensure that its conditions are satisfied. First, the same proof as that 
of Lemma 2.7 yields: 

Lemma 5.4. Let Assumption 1.2 hold. Then, ^(log |M*|) > 0. 

In addition, we have: 

Lemma 5.5. Let Assumption 1.2 hold. Then, the process log|M*| is 
nonarithmetic relative to the Markov chain (a;*)„gz with transition kernel 
IL* defined in (5.10) (in the sense of Definition 1.4). 

Proof. Since the process log \pi \ is nonarithmetic relative to the Markov 
chain (xn)nGZ with kernel H, the claim follows from Lemma A. 6 in [2], which 
deals with the nonarithmetic condition relative to the "sampled" Markov 
chain (x*)„gz- □ 

We are now in position to complete the proof of part (a) of Theorem 1.8. 

Lemma 5.6. Let Assumption 1.2 hold and suppose in addition that 
limt^oo i'^-PjTd-^l > ^) = for ir-almost every x & S. Then, (1.6) holds with 
the function T{x) defined in (5.3). 

Proof. For n e Z, let a„ = -R* + r(x* _]^)II* and write a„ = Un-i + Pn, 
where 

Pn = Q*n-iK-i + r«_i)n; - t{x:_,)k_, 
= K-iiQn-i + r«_i)M;_i - r«_2)). 

Set 

(5.11) 5„:=Q: + r«)M*-r(x;_i). 

Thus, a„ = On-i + Pn = On-i + and hence for any e > (cf. [9], 

page 157): 

P~(|a„| > t for some n>0)> P~(|/3,„| > 2t for some n > 0) 

> P~(|n* I > 2t/e and |(5„| > e for some n > 1). 



28 A. ROITERSHTEIN 

Indeed, > 2t implies that either |an_i| > t or, if not, |a„| > — 
I > 2t — t = t. 

Fix a number e > and let v{t) = inf{n > 1 : jll* | > 2t/e}. Then, setting 
(5.12) K::=log|n:| = ^log|M;|, 

i=0 

we obtain from (5.8) and the Markov property that for any z G Sq, 



j Pz «(f)-i e dx, I > e, v{t) < co) 



> 

2 J So 

= %E-{P-. {\5o\>e);v{t)<^) 



(0\(z)^,"(e-^(^A.,-^°^(2*/^))p-^^^_^(|5o| > e)/Kxl^,^_,)l 



Ife 
2 



where the expectation E~ is according to the measure P~ defined in Sec- 
tion 2.3. 

Thus, in virtue of part (b) of Theorem 1.6 it suffices to prove that under 
Assumption 1.2, 

either 

(i) for some e > and probability measure vr absolutely continuous with 
respect to vr, either the following limit exists and is strictly positive: 

(5.13) lim ^r(e-^(^4)-^°^(^*/^))p," ^ > e)), 

t — >00 — 1 

where ^r(.) := /^^ ^-(.)7r(dz), 
or, if not, 

(ii) then, (1.6) holds with the function r(x) defined in (5.3). 

To bound the limit in (5.13) away from zero we will apply Corollary 2.6 
to the Markov chain {xn)nez on {So,To) introduced in (5.5) and governed 
by the kernel H* defined in (5.10), the random walk V* defined in (5.12), 
and the function 

g{x,t) = e-^'p-{\6o\>e). 

Let a-i = -1, V*i = 0, and for n > 0, o-.„ = inf{i > an-i'-V* > V*^^_^}. 
Further, let vr be the stationary distribution of the Markov chain a;„ := x*^ 

under P (which exists and is unique by [2] , Theorem 4) . The measure tt is an 
irreducible measure of the Markov chain (x* )nez with transition kernel H* 
and hence is absolutely continuous with respect to its stationary distribution. 
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which in turn is equivalent to the stationary distribution vr of (x* with 
transition kernel H* . _ 

To apply Corollary 2.6 to the Markov chain (a;* )„,gz with kernel H* and 
the random walk V^, we need to check conditions (2.13) and (2.14) for the 
function 

6(x,y) = 4-(e-'^(^o-^)l^^^^^^Pr(|5o|>e)), 
where K := V*^. 

Condition (2.13) follows from the following estimate valid for any 5 > 0: 

\b{x,y + 5) - b{x,y)\ < ^ {\e^\^^^^^^^^ - l^^^^^^l) 

= {e^' - l)P-(Vo >y + S)+p-{y<%<y + 6). 
As to condition (2.14), we have: 

'e'^y, if2/<0. 



E-{l^y^^y^) = P-{Vo>y), ify>0. 



Hence, 

/ \Kx,y)\'^{dy) 

oo „ oo 

< ^ e— + / ^ > n)7r{dx) < oo, 

n=0 n=0 

because by part (iv) of [2], Theorem 2, 

^ oo ^ 

/ Y.P^~(^o>nMdx)< E-{Vo)7r{dx)<^. 

(Part (iv) of [2], Theorem 2 implies that the constant //i in the statement 
of Corollary 2.6 is finite. In our case, ni = J^^ E~ (yo)Tf{dx).) 

Let H be the transition kernel of the Markov chain {xn,yn — ^-i)n>o- 
It follows from Corollary 2.6 that for some (0, 1), 

t^OO v{t) 

1 



e ""'P {5q > e)dwH{x,dy x dz)TT{dx) 

/^l J So JSoy.{0,oo) J[0,z) 

— [ [ {l-e^''')p-{\6o\>e)Hix,dyxdz)Tr{dx) 

fJ-ll^ JSo JSox{0,oo) 



>Af I Py{\6o\> e)H{x,dy X {0,oo))Tf{dx) 
JSo -J So 

= A f p-{\So\>e)7T{dy) = AP7{\So\>e). 

J So 
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It follows that if (5.13) is not true for any e > then 

(5.14) pr(5o = 0) = l. 

It remains to show that (5.14) implies that (1.6) holds for the function T 
defined in (5.3). By the definition of the kernel H* in (5.6) and the quantity 
5n in (5.11), we get from (5.14) that 

(5.15) Pr(i?„ + r(x„)n„-r(x_i) = 0) = l forallneN. 

Taking respectively n = and n = 1 in the last equality we obtain that 

p--(eo + r(xo)po - r(x_i) = 0) = pr(eo + Cm + t{xi)popi - r(x„i) = o) = 

1. It follows that 

pr(6 + r(xi)pi-r(xo) = o) = i. 

Similarly, by induction on n, one can show that 

Pr(^„ + T{xrr)pn " r(x„_i) = 0) = 1 for all n e N. 

Since the Markov chain (x^) is vr-recurrent and fc is absolutely continuous 
with respect to it, we obtain (1.6). □ 

5.4. Proof of parts (b) and (c) of Theorem 1.8. Let Sq be as defined in 
Lemma 2.1 and recall the regeneration times A'^ defined in Section 2.1. Let 
Qo = Co + l{7Vi>i} EilV^ ^i+i ni=o Pj and Mq = Ilil'o Pi^ and forn > 1, 

A^n+l-l i N„+l 

Qn =CAr„+l + l{Ar„+i-Ar„>2} IT Pj ^'^'^ = IT P^' 

i=N„+l j=N„+l i=N„+l 

The pairs {Qn,Mn),n > 0, are one-dependent and for n>l they are iden- 
tically distributed. Since the series in (1.2) converges absolutely, we obtain 
the representation 

(5.16) R = Qo + MoiQi + Mi(Q2 + M2{Qz + • • •))) := + M^R. 

Note that xat-^ is distributed according to the measure introduced in 
Lemma 2.4 and hence f (|-R| > t) = ^^(1-^1 > where we denote as usual 
^^"(•):=/5^."(-)^('i^)- Wehave: 

Lemma 5.7. The following limit exists and is strictly positive: 

(5.17) K= lim t^'p-im >t)= lim t^'Pim > t). 

t— >oo V t—tOO 

Proof. The measure '0 is an irreducible measure of the Markov chain 
{xn)nez and hence it is absolutely continuous with respect to its stationary 
distribution vr. Therefore, the claim follows by the bounded convergence 
theorem from part (a) of Theorem 1.6 and part (c) of Lemma 3.2. □ 
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We will show next that the contribution of Qq in R is negligible in the 
following precise sense [recall that ^„ are assumed to be bounded by (2.5)]: 
for some f3 > k, 



(5.18) sup E~ 



Ni-1 i 

iw>i} E n \Pi\ 

i=0 jr=0 



< oo. 



Let A{x) = ([l|7Vi>i} Y^f=o ^ 11^=0 < Since for any positive num- 

bers {aj}"^]^ we have (oi + 02 + - • ■ + anY ^ ^^^(al +• • • + a(^), we obtain 
for any /? > and x G 5o : 

Coo n— 1 i \0 
n=l i=0 jr=0 / 
00 / n— 1 2 \ /5 

(5.19) =E^x Elli^iiVi-} 

n=l \ i=0 jr=0 / 
00 n— 1 / * \ 

<E-'E^." nip.i'Wn} • 

71=1 i=0 \j=0 / 

Let 

Qfs{x,dy) ■.= Q{x,dy)E{\pQpip2 - ■ ■ Pm-i\'^\x-i =x,Xm-i =y), 
where the kernel @{x,dy) on (Sq^Tq) is defined in (2.3), and let 

Kf3{x,dy) := H"^{x,dy)E{\popip2 - ■ ■ Pm~if\x-^i =x,Xm-i = y) 
= H^ix,dy), 

where the kernel Hp on (50,70) is defined in (2.10). 
Then for any x gSq, 

Qplix) =E-\^l[ \pj\^l{N^>m}j and Kpl{x) = R \Pjf] ■ 

By Lemma 2.1 and (2.5), the kernels and Qp satisfy the conditions of 
Proposition 2.4 with s{x,y) = E{\pQpip2 - ■ ■ Pm-i\^\x-i = x,Xm-i = y) and 
ci = c~™. In virtue of Lemma 2.3, the spectral radius of and hence -ftT^ 
is equal to 1. Thus, by part (c) of Proposition 2.4, the spectral radius of 0^ 
is strictly less than one. Since r~ is a continuous function of /3, we have for 
some (3> n: 

(5.20) rg^ < 1. 
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For / G N, denote I = m ■ max{[l/m], 1}, where m is as in (2.1). We obtain 
from (5.20) that for any / G N,n > max{Z,m}, x £ Si, and for suitable con- 
stants Ap >0,Ap< 0: 



l-i 

( n \Pj\^\N,>n} ] < C^E- ( n \Pj\^l{N,>n} 
\j=0 ) \j=0 



where in the first inequahty we use (2.5) and the fact that n < n for n > m 
(note also that < 1 by Proposition 2.4 applied to the kernels H and 6). 
This yields (5.18) in virtue of (5.19). 

Fix some (3 > k which satisfies (5.18) and a € (^, 1). By (5.19) and the 
Chebyshev inequality, limf^oo f^Px i\Qo\ ^ i") =0 uniformly in x. Let 

A^l -m Ni 

^0,1 = l{7Vi-m=-l} + l{7Vi-m>0} • H \Pi\ ^'^'^ ^0,2= H l^^l" 

i=0 i=Ni-m+l 

Then, Mq = Mo,i • Mo,2 and c-'^Mq < Mo,i < d^Mo, where Cp is introduced 
in assumption (A4). 

Recall the random variable R defined in (5.16) and note that Mo,i and R 
are independent under the measure P~ because only the m — l last variables 
in the block {xo,xi, . . . ,X]\fi~i} are dependent on x^i- 

For any f3> k such that (5.18) holds, we have 

ep-{\R\ >t)< t^p-{m + |Moi?| > t, igol < n + t"p-(|gol > n 

< ep-{\M,R\ >t-n + ^E-{\Qof) 

< eP~{d;\MoAR\ >t-n + E-{\Qof). 

The expectation £'~(|go|^) is bounded on Sq by (5.18), while (5.17) and the 
fact that R is independent of Mq i under P~ imply that for some L > 0, 



t'^p-(c^|Mo,ii2|>t-0<L(^^-^j E~{\Mo,in Vt>l 

yielding the upper bound in (1.7) since the expectation £^~|(Mo,i|'^) is 
bounded on Sq in view of (5.18). 

To get the lower bound in (1.8), write 

t'^p-m >t)> t^p~{\MoR\ - igol > t) 

>t^p-{\MoR\-\Qo\>t,\Qo\<e) 

> t^p-{\MoR\ >t+n- p-{\Qo\ > n 
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> t-P~{\MoR\ >t + n- ^E-{\Qof) 

>t-p-{c;^\Mo,iR\>t + n-^E~{\Qo\''), 

and note that j^E~ {\Qq\^) converges to zero uniformly on x by (5.18) while 
by (5.17) we have for any A > 0, some constant J > that depends on A, 
and all t large enough: 

t^p-{c-'^\Mo,iR\ >t)> ep-{\ ■ c-"^ ■ \R\ > t; |Mo,i| > A) 

> JP-(|Mo,i|>A). 

To complete the proof it remains to show that for some A > there exists a 
number 6i> such that 

P^7(|Mo,i| > A) > 5i, TT-a.s. 

Toward this end observe that for every x G So, with € N defined in (2.4) and 
Cp > defined in (A4) (we will assume, actually without loss of generality, 
that '& > m), 

p-(|Mo,i| > c;(''-™)) > P~ (\MoM > mill c,-(-™);iVi < A 

= P-iN,<^)>5, 
where (5 > is defined in (2.4). 

APPENDIX A: PROOF OF PROPOSITION 2.4 

(a) First, we note that if a nonnegative eigenfunction / ^ of the opera- 
tor K -.Bfy^ Bh exists then necessarily inf^; f{x) > 0. Indeed, assuming that 
Kf = Xf for some A > 0, we have for any x £ Sq, 

d+m d+m d „ „ 

Y A7(x) = E K'fix) >J2 / K'i^^ dz)K^{z, dy)f{y) 
i=i 1=1 i=i •'^^ -^^^ 

>P-ci'- f fiy)tl^idy)>0, 

where the last inequality follows from the fact that f{x) > for every x £ Sq 
(cf. [18], Proposition 5.1(ii)). 

The proof of the existence of such / G Sf, is an application of Nussbaum's 
extension of the Krein-Rutman theorem (cf. Theorem 2.2 in [19]). Theo- 
rem 2.2. In view of this theorem (this is explained in Appendix B) it is 
sufficient to show that there exists a double-indexed sequences of compact 
linear operators Qn,i on the space Bf, such that 

(A.l) limsupv/||K* -Q„,i|| < 1/n, n G N. 
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It even suffices to show tliat limsupj^oo y — < 1/n for some 

compact operators Qn,i on Bj,, since we can then set Qn,i = K'^~'^^'Qn,ji, 
where ji is the integer part of i/m. For this purpose we shall adapt the 
Yosida-Kakutani's proof that Markov kernels satisfying Doeblin's condition 
are quasi-compact (cf. [24], Section 4.7). 

(1) First, we observe that if n{x,y) and j{x,y) are jointly measurable 
bounded function, then the product of the two operators defined by the ker- 
nels N{x,dy) = n{x , y) fi{dy) and J{x,dy) = j{x,y)iJ,{dy) is compact in Bb- 
Indeed, we can approximate n{x, y) in Li{Sq x 5o, Tq x Tq, x /i) up to 1/i by 
a simple function ni{x,y) which is a finite linear combination of the indica- 
tor functions of "rectangle" sets Bi k x Ci^k, where Bi^k-,Ci,k C Sq. Then, the 
operators corresponding to the kernels Ni{x,dy) = ni{x,y)fj,{dy) are finite- 
dimensional and hence JN = limj^oo J^^i, being the limit in operator norm 
of a sequence of compact operators, is compact. 

(2) Fix n G N and let 6 = 6{l/n) be defined as in condition (iii) of the 
proposition. Let k(x,y) be a jointly measurable density of the kernel K"^ 
with respect to /i (such a density exists since the cx-field Tq is assumed to be 
countably generated, see, e.g., [18], Lemma 2.5) and set 

qnix,y) = inm{k{x,y),5-^ ■ ||K™||}. 

Let Dx = {y G 5o : k{x, y) / qn{x., y)}, thus k{x, •) > ll-f^"*!! on D^. Since 

supK'"(x,Z),) = sup / k{x,y)fiidy)<\\K'^\\, 

X X J Dx 

then fJ,{Dx) <S. Hence, letting Qn{x,dy) = qn{x , dy) fi{dy) , 

||i^"-Qn,|| <sup J k{x,y)n{dy)=supK"'{x,Dx)<l/n. 

(3) Let Rn = K'^- Qn- Then K"^^ = (Q„ + R^y = ^ of 2^ terms each of 
them, except maybe those i + 1 where Qn appear at most once, is compact 
by (1). But 

II -^n Qn^n ~^ RnQnRn ~l~ ' ' ' ~l~ Rn Qn\\ 

< (1/n)* + i • ||Q„|| • {1/ny-' < (1/n)* + i • ||K'"|| • (l/n)*-\ 
as required. 

(b) The proof for the kernel on (5i,7i) is the same as for K, since the 
conditions of this proposition hold for Q as well (with d = m = 1). 

(c) Let > 1 be a constant such that f{x) £ (c~"'^,c^-) for all x G Sq. 
Then, for any x gSq, /(x) < l(x) < c^^,/(x), and hence 

(A.2) c-\l<K^l{x)<clrl VxG^q. 
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Let K{x,-) be the restriction of the kernel to the states of the set Si. 
It follows from (A. 2) that the spectral radius of K coincides with r™. 

By [18], Proposition 5.3 and [18], Theorem 5.2, the kernel has an in- 
variant measure vrg. Since r™/ > Qf, the equality rg = would imply by 
[18], Proposition 5.3 and [18], Theorem 5.1 that vrg-a.s., @f{x) = r^f{x) = 

K"''f{x), which is impossible because f{x) > and K"^{x,dy) — Q{x,dy) > 
rc^^ip{dy) for any x E Si. Hence rg < r™. 

APPENDIX B: THE NUSSBAUM FIXED POINT THEOREM 

This appendix is devoted to the Nussbaum's extension of the Krein- 
Rutman fixed point theorem (cf. Theorem 2.2 in [19]) or, to be precise, 
to the version of this theorem which is actually used in (A.l). 

Let X be a Banach space. For a bounded subset S of X, Kuratowski's 
measure of noncompactness a{S) is defined by 

a{S) = mil d>0:S =\J Si,n£N, and D{Si) < d for 1 < f < n 
I i=i 

where D{S) := sup^ ,^g5 ||x — y\\ is the diameter of the set S. 

A bounded linear operator i(' in X is called a b- set- contraction for a 
number 6 > if a{K{S)) < ha{S) for every bounded subset S oi X. A closed 
subset C of X is called a cone if the following holds: (i) if G C and 
a,/3 > are nonnegative reals, then a.x + (3y ^ C. (ii) if x G C — {0}, then 
-x^C. 

Theorem B.l ([19], Theorem 2.2). Let X he a Banach space, C he a 
cone in X, and K be a hounded linear operator in X such that K{C) C C. 
Let 

\\K\\^ :=sup{||i^n|| -.uGC, \\u\\ < 1} 

and a^{K) := mf{b > : is ah- set- contraction}., where :C ^ C is the 
restriction of K to the cone C. Further, let 

rJK):= lim ^||K"|L and pJK) := lim ev^a„(K"). 

Assume that Pf^{K) < r^{K). Then there exists an x £ C — {0} such that 
Kx = r^{K)x. 

We want to apply this theorem in the situation of Proposition 2.4, namely 
to the Banach space the operator K defined by Kf = J^^ K{x,dy)f{y), 
and the cone C of nonnegative functions in Bb. Note that r^{K) coincides 
with the spectral radius in this case. It follows from (2.8) and the as- 
sumption s{x,y) G (cj~^,ci) that r^^ > Ci Therefore it suffices to show 
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that (A.l) implies Pc{K) = 0. Since pc{K) < Px{K) (cf. [19], page 321), it 
is even sufficient to show that Px{K) = 0. 

It will be convenient to use the notion of the Hausdorff measure of non- 
compactness X which is defined for a bounded subset 5 of a Banach space 
Xhy 

xiS) = inf{d > : 5 has a finite d-net in X}. 

By finite d-net in X we mean a finite subset {xi, . . . , x„} of X such that for 
any y G 5 there exists an index j s.t. \\y — Xj\\ < d, where || • || is the norm 
on X. 
Let 

X{K) := inf{6 > : x(K{S)) < bx{S) for bounded subsets S of X}, 

and cr{K) := lim„_^oo \/x{K^). The Kuratowski and Hausdorff measures 
of noncompactness are equivalent in the following sense (cf. [1], page 4): 
x{S) < a{S) < 2x{S) for every bounded subset S of X. Thus, it suffices to 
show that (7{K) = when (A.l) holds. The latter assertion follows from the 
following lemma. 

Lemma B.2. Let X be a Banach space and K be a bounded linear oper- 
ator in X. Further, let e > be a positive constant and assume that there is 
a compact operator Q in X such that \\Q — K\\ < e. Then, x{K) < 2e||J^||. 

Proof. Fix a bounded set 5 C X. Let {xi, X2, ■ . ■ , Xn} C X be a finite 
d-net of 5 for some d > 0. It suffices to show that the set K{S) has a finite rj^- 
net in X, where we denote r/^ := 2e(i||i^'||. Let Bi, i = 1, . . . ,n, be the balls in 
X of radius d and centered in Xj. Then, S C IJ"^^ Bi and K{S) C [j^^i K{Bi). 
Therefore, it is sufficient to show that each set K{Bi), i = 1,2, . . . ,n, has a 
finite 7?rf-net in X. 

Fix any 6 > 0. By the semi-homogeneity property of the measures of 
noncompactness and their invariance under translations (cf. [1], page 4) we 
can assume without loss of generality that d = 1 and consider only the unit 
ball Bq centered at £ X. Let Z := {zi,Z2, ■ ■ ■ , Zm} be a finite 6-net of the 
totally bounded set Q{Bq). Then, the balls of radius 5 + \\K\\ ■ \\K — Q\\ with 
centers in zi, Z2-, ■ ■ ■ , Zm cover the set K{Bq). Indeed, for a point x G K{Bq), 
let z{x) £ Z he such that \\Qx — z{x)\\ < 5. Then, 

||i^x-z(x)|| < \\Kx-Qx\\ + \\Qx-z{x)\\ < ||x|| • \\K - Q\\ + 6 
< \\K\\ • \\K -Q\\+6< \\K\\ ■ \\K - Q\\ + 6. 

This completes the proof of the lemma since (5 > is arbitrary. □ 
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